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FIELD OF THE INVENTION 

The present disclosure relates to a method for testing circuits. More particularly, 
the disclosure relates to a method of testing circuits having analog components, and a 
method of developing the tests applied to them. 



Currently, comprehensive and low-cost test methodologies for analog and mixed- 
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signal systems analogous do not exist. Test methodologies for mixed-signal systems are 
based primarily on the paradigm of measuring the circuit's specifications to determine if 
they are "good" or "bad". This method is known as specification based testing. With this 
method of testing, each specification is measured for each circuit, e.g., an integrated 

5 circuit (IC), to ensure that the circuit satisfies all specified parameters. 

Specification based testing has many drawbacks. Foremost perhaps is the cost 
associated with such testing. Testing costs include both the cost of test development as 
well as the costs associated with conducting the actual manufacturing tests. The cost 
factor becomes critical in high volume production of analog and mixed-signal ICs. Most 

q of the previous research in test generation for fault detection in analog circuits assumes 
that a list of faults for which tests are to be generated is given. This approach is known as 
fault based testing. Realistic fault lists can be generated from analysis of the circuit 
layout using inductive fault analysis (IF A) based techniques. 

In the past, test researchers have proposed eliminating some of the tests from the 

5 conventional specification test set to reduce production test cost. Theses researchers have 
been motivated by the fact that many of the specification tests contain redundant 
information about the underlying process defects. For instance, the correlation between 
specification tests has been used for test elimination. A more rigorous approach for test 
elimination based on QR factorization of linear models has also been proposed. During 

►q production testing, not only the number of tests but also the order in which they are 
performed affect the overall testing time and test quality. Thus, a further reduction in 
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average production testing time can be achieved by performing those specification tests 
first, which take the least time and have the maximum fault coverage. A graphical 
theoretic approach has also been used to optimize specification tests. Although the tests 
derived using the above mentioned testing schemes can substitute for the conventional 
specification tests performed during the final test stage of analog circuits, these test 
methodologies again resort to costly (although optimized) specification tests for fault 
detection. 

From the foregoing, it can be appreciated that it would be desirable to have a testing 
method for circuits, such as analog ICs, which accurately predicts circuit performance and 
which is low in cost to develop and perform. 

SUMMARY OF THE INVENTION 

The present disclosure relates to a method for testing a circuit having analog 
components. The method comprises performing a low-cost optimized test on the circuit 
by applying an optimized input stimulus to the circuit, capturing the circuit response to 
the input stimulus applied to the circuit, evaluating the circuit response to predict whether 
the performance parameters of the circuit satisfies predetermined specifications for the 
circuit, and making a pass/fail determination for the circuit based upon the evaluation of 
the circuit response. 

In a preferred embodiment, the method deriving synthesizing functions which map 
measurement responses of the circuit to circuit performance parameters, applying an 



3 



TKHR Docket No. 62004-1400 



optimized input stimulus to the circuit, capturing the circuit response to the input stimulus 
applied to the circuit, evaluating the circuit response with respect to the derived 
synthesizing functions to predict whether a predetermined number of performance 
parameters of the circuit satisfies predetermined specifications for the circuit, making a 
5 pass/fail determination for the circuit based upon the evaluation of the circuit response, 
and for circuits for which a clear pass/fail determination cannot be made, performing 
specification based tests with respect to particular predetermined circuit specifications to 
make a final pass/fail determination for the circuit. 

With these inventive methods, circuits such as analog ICs can be tested much more 
JO quickly and much more cheaply. The features and advantages of the invention will become 
apparent upon reading the following specification, when taken in conjunction with the 
accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The invention can be better understood with reference to the following drawings. 
The components in the drawings are not necessarily to scale, emphasis instead being placed 
upon clearly illustrating the principles of the present invention. 

FIG. 1 is a high level flow diagram of a testing methodology in accordance with the 
present invention. 

FIG. 2 is a flow diagram detailing a first portion of the testing methodology shown 
in FIG. 1. 
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FIG. 3 is a schematic representation of various parameter spaces. 
FIG. 4 is a flow diagram detailing the first portion of the testing methodology shown 
in FIG. 2. 

FIG. 5 is a schematic view of mapping between parameter spaces. 

FIG. 6 is a flow diagram of an example test flow. 

FIG. 7 is a flow diagram of generation of critical circuit instances. 

FIG. 8 is a is a schematic of a routine showing steps involved in synthesizing 

mapping functions. 

FIG. 9 is a graphical representation of standard deviation of measurements. 
FIG. 10 is a schematic representation of string encoding. 

FIG. 1 1 is a schematic representation of use of uniform crossover to create child 

strings. 

DETAILED DESCRIPTION 

Overview of the Test Methodology 

Referring now to the drawings in which like numerals identify corresponding 
components or steps, FIG. ^illustrates a high level view of a testing methodology in 
accordance with the present invention. In an effort to reduce the cost of testing, the final 
test procedure can be divided into two stages. As shown in FIG. 1, the circuit under test 
(CUT) is first subjected to a set of low-cost optimized tests derived from the CUT's 
specifications, as indicated in block 10. These tests can be conducted by applying an 
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input stimulus (described below) to the circuit and observing the response, e.g. in the 
form of a waveform, to determine whether the circuit operates in compliance with a 
majority of the specifications established for the circuit. Once these tests have been 
performed, the test results are evaluated, as shown in block 12, to determine whether the 
CUT passes with respect to the various predetermined specifications. At this point, it can 
be determined, at least with respect to some circuits, whether the circuit passes (is good) 
or fails (is bad). 

Because of measurement errors, modeling errors, and mathematical residuals 
inherent to the test derivation process, the low-cost optimized tests which are the subject 
of the present disclosure may reject circuits that actually pass each designated 
specification or accept circuits which do not pass each designated specification. 
Therefore, at 14, some circuits may fall into a third category in which it is not clear from 
the optimized tests whether the circuit passes or fails. For these circuits, critical 
specification based tests can be applied in a second stage with respect to particular 
predetermined specifications in the conventional manner, as indicated in block 16, to 
ensure that each approved circuit complies with each specification. Determination of 
which specifications for a given circuit will be specification based tested can be made by, 
for instance, initially comparing the test results obtained for each specification with the 
low-cost optimized tests with conventional test results for each specification. In this 
manner, the accuracy of the low-cost optimized tests can be assessed on a specification- 
by-specification basis. Accordingly, the overall test process can comprise first applying 
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the low-cost optimized tests to the CUTs, and then applying critical specification based 
tests to circuits which do not clearly pass or fail with respect to certain predetermined 
circuit specifications to make a final "good" or "bad" determination. With this 
methodology, the overall test cost is significantly smaller as compared to what would be 
incurred by applying specification based tests to every circuit with respect to each circuit 
specification. 

FIG. 2 illustrates the first portion of the test method in greater detail. More 
particularly, this figure shows various steps involved in blocks 10 and 12 of FIG. 1. As 
shown in FIG. 2, the input stimulus is first applied to the circuit as indicated in block 20. 
Once this stimulus has been applied, the output response of the circuit can be captured 
(block 22) and, if desired, stored. From this response, the circuit specifications can be 
predicted, as indicated in block 24, so that pass/fail determinations can be made with 
regard to the predetermined specifications, as indicated in block 26. 

Theoretical Background 

For a better understanding of the test generation methodology that follows, the 
theoretical background of the present invention is provided. The performance of a 
circuit, such as an analog IC, is determined by a set of associated process parameters, i.e., 
the parameters under which the circuit is constructed. For instance, such parameters can 
include the temperatures used during fabrication, the chemical compositions used, etc. 
These parameters can be denoted as p=[pi, P2 , Pn P ,]> where n p is the total number of 
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process parameters which affect the circuit performance. As identified in FIG. 3, a 
circuit fabricated in this process can be represented by a point in the n p dimensional 
process parameter space. 

The design of an analog circuit is evaluated using various performance parameters 
which reflect the circuit's transient, frequency, and DC performance metrices. In other 
words, these performance parameters correspond to the specifications to which the circuit 

operates. The performance parameters can be denoted by s = [si, S2, , s„J 9 where n s 

is the total number of performance parameters. Hence, a circuit can also be represented 
by a point in the n s dimensional performance parameter space. The performance 
parameters of a circuit can be related to the associated process parameters through a set 

of n s mapping functions denoted by f ps = [f pS L fps2> , fpsns]- This is to say that the 

relation between the performance of the circuit and the processes used to manufacture the 
circuit can be defined as in equation [1]. 

n 

fpsi- p->s h peSl , s, e <R , i = /...*, [Equation 1] 

As will be understood by persons having ordinary skill in the art, the performance 
parameters of the circuit are to satisfy certain specifications which are given by lower 
and/or upper bounds on the performance parameters. The specifications with a single 
bound can be designated as single ended specifications and those with both upper as well 
as lower bounds can be designated as double ended specifications. For the purposes of 
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test generation, all the double ended specifications on the CUT can be decomposed into 
two single ended specifications, giving a total of n b single ended specifications (the 
subscript b standing for bound). Note that if there are n } performance parameters with 
single ended specifications and n 2 of them with double ended specifications, «/ + n 2 = n s 
and n b = ni + 2n 2 . The lower or upper bound of the t h single ended specification can be 
denoted as The f* single ended specification (on the performance parameter s ; ) 
defines a region A sj in the n, dimensional performance parameter space containing all 
performance parameter values satisfying 
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\i = 



Sj > b- if lower bound 
Sj < bj if upper bound 



[Equation 2] 



Performance parameter sets satisfying all the n b single ended specifications form the 
acceptance region in the performance parameter space (As) are defined by 
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A = n \i- 



i= I n h 



[Equation 3] 



Circuits with performance parameters lying in this region are classified as fault free or 
good circuits while circuits with performance parameters outside this acceptance region 
are faulty or bad circuits. Since the performance parameter space and the process 
20 parameter space are related by the mappings given in equation [1], the acceptance region 
in the performance parameter space is implicitly related to the acceptance region in the 
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process parameter space (A p ) as defined by equations [4] and [5]. 
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A p i = j/7 € **'\f{p) e A Jtf | [Equation 4] 



A p = A ■ [Equations] 



One goal of the test generation method used herein is to find easy-to-perform 
measurements in which the CUT can be classified as good or bad. Assuming there are n m 
measurements represented by m=[mi, m 2 , m nm ] t there is an n m dimensional 
10 measurement space in which the CUT can be represented by a point. These 
measurements are related to the process parameters of the circuit, with points in the 
process parameter space mapped onto the measurement space by n m mappings, 
jpm=[f pml ,f pm2 , -^fprnml as defined in equation [6]. 



n 

f pmj : p^m h pe3i F J m i eSi , /«/....n m [Equation 6] 



Every circuit instance within the acceptance region in the process parameter space can be 
mapped into the measurement space using the mappings of equation [6] to give an 
acceptance region in the measurement space (A m ) defined by equations [7] and [8]. 



A m, i = \ m = fpm(P) € P € A />, i [Equation 7] 
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Am " i»D..«* Afl,/i [Equation 8] 



The functional mappings f ps and are, in general, not available in closed form and these 
^ mappings are evaluated for a given p via numerical circuit simulation. According to 
rigorous mathematical definitions, the dimensions of the above mentioned spaces are 
equal to n p , n s , and n m> conditional on the linear independence of the process parameters, 
performance parameters, and measurements respectively. 

From the above discussion, it can be appreciated that the manufacturing 
parameters, performance parameters, and testing responses of a given circuit can be 
defined in terms of process parameter space, performance parameter space, and 
measurement space, and further that each of these spaces are related to each other. Just 
as a change in the parameter space, i.e., a fluctuation in a manufacturing parameter, will 
have an affect on the performance space, an input stimulus can be created which, when 
15 applied to a CUT manufactured with an incorrect process parameter, will yield a change 
in the measurement space which can be observed so that the defective nature of the 
circuit can be readily identified. As is discussed in greater detail below, one goal of the 
present method is to design tests which maximize the change in the measured response of 
the circuit so that defective circuits can more readily be identified. 

20 



11 



TBCHR Docket No. 62004-1400 



Defining the Relationship Between Measured Response and Performance Parameters 

From the foregoing discussion, it is apparent that, if the relationship between a 
measured response to an applied stimulus and the performance parameter of a circuit can 
be derived, the response can be used to predict compliance with the specifications. Thus, 
given a set of measurements obtained after applying the input stimulus, determining the 
test criteria involves finding the boundaries of the acceptance region in the measurement 
space. In other words, the relationship between the measured response and the various 
circuit specifications can be defined as a plurality of functions which map the measured 
response to each individual circuit specification. Once these mapping or synthesizing 
functions have been developed, the actual measured responses of a circuit to the input 
stimulus can be input into the mapping functions to make the pass/fail determination. 
Accordingly, the present testing method can further be represented as shown in FIG. 4. 
In this figure, the input stimulus is applied to the CUT at block 40. The response 
resulting from the application of the input stimulus is then measured, as indicated at 
block 42, and stored if desired. Once this measured response has been received, it can be 
input into the various mapping or synthesizing functions for the various circuit 
performance parameters (i.e., specifications) as indicated in block 44. The mapping 
functions can then be evaluated to determine whether the circuit satisfies each individual 
specification, as indicated in block 46, so that a pass/fail determination can be made, as 
indicated in block 48. At this point, flow can continue to specification based testing, if 
needed, as indicated in FIG. 2. 
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In a preferred arrangement, the measurements obtained from applying the test 
stimulus are post-processed to define the test thresholds on the post-processed data rather 
than the measurements themselves. This process can be designated measurement 
synthesis. The measurements are post-processed using a set of rib synthesizing functions 
(fms= <Tmsi,.fms2,..~,fmsnbJ) to yield n b synthesized measurements (9 = [9 l5 0 2 ,... 5 G nb ])- This 
measurement synthesis can then be used to derive accurate test criteria for analog circuits. 

Measurement synthesis involves deriving rib synthesized measurements from the 
n m original measurements using the rib synthesizing functions. All the information about 
the performance parameters of the circuit can be extracted using the synthesizing 
functions. As will be appreciated by persons having ordinary skill in the art, the 
synthesizing functions are preferably derived near the boundary of the acceptance region 
within performance parameter space to increase the accuracy of the functions in 
predicting a passing or failing performance parameter. 

Suppose for a circuit instance p, the f h performance parameter is very near to the 
specification bound b h i.e., pis a critical circuit instance. 

fpsj (P) * b i f° r an y 0<i<n b [Equation 9] 

Then the synthesizing function for the specification bound 6, need to be derived such 
that 

Sj = f P sj (P) = /- if P m (P)) - 0, [Equation 10] 

13 
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In order to understand the relation given in equation [10], consider FIG. 5. As illustrated 
in this figure, the circuit instance p is mapped to the performance parameter space and the 
performance parameter sj is very close to the specification bound Equation [10] 
requires that the i th synthesized measurement fmsi(m) be equal to the j th performance 
parameter sj. Notice that two different subscripts i and j are used since, as described 
above, a performance parameter can have a double ended specification on it. In that case, 
two synthesized measurements are derived, one tracking the performance parameter 
accurately near the upper bound and the other one tracking it accurately near the lower 
bound. Thus, if the post-processing function satisfies the relation given in equation 
[10], then the synthesized measurements for the critical circuit instances become equal to 
the corresponding performance parameters. As a consequence, the specification bound b t 
itself becomes the test criteria for the i th synthesized measurement. Thus, the problem of 
accurate boundary determination can be converted to one of function approximation 
using measurement synthesis. 

The aforementioned technique provides several advantages. First, since the 
synthesized measurements track the performance parameters, physically interpretable test 
criteria are obtained. Synthesized measurements contain much more information about 
the performance parameters than the measurements themselves, which is helpful for 
diagnostics. Second, there are robust nonlinear function approximation techniques which 
can be used to derive the synthesizing functions. Thus, the synthesizing functions can 
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capture highly non-linear relations between measurements and performance parameters. 
For instance, as discussed below, a multivariate regression technique can be used to 
derive the synthesizing functions. Third, the misclassified circuits can be identified and 
handled systematically with this approach. For instance, as discussed below, various 
5 errors associated with the measurement synthesis can be incorporated to identify the 
circuits which are likely to be misclassified due to these errors. 



Derivation of the Synthesizing Functions 

The functions f ps and f pm are very complex and are not available in closed form. 
Therefore, it is difficult to directly derive the synthesizing functions using equation [10]. 
However, function approximation using regression can be used. Ideally, the technique 
used for approximating the functional mapping between measurements and performance 
parameters should be able to approximate highly nonlinear functions accurately, should 
be able to handle large dimensionality of dependent variables, and should be immune to 
j 5 the problem of over-fitting. Multivariate Adaptive Regression Splines (MARS) is a 
known tool which has the above mentioned desirable properties. Hence, it can be 
desirable to use MARS to derive the post processing functions f m . One can also use 
neural networks or any other regression strategy to approximate the function f m . By way 
of example, the model produced by MARS can be of the form 

20 

fix) = a 0 + jr a m • Bl (x) [Equation 1 1] 
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where the coefficients a m are chosen to minimize the squared error of the regression 
model. B m (x) are splines of the form 



Each basis function is a truncated power spline basis function of desired order qx^m is 
one of the variables in x and is the knot location for the basis function. MARS 
modeling strategy is to progressively add basis functions based on the maximum 
reduction in the squared error of the model, until an over-fitted model is obtained. This 
basis set is then subjected to a backward stepwise deletion to produce the final model. 
While using measurement synthesis to determine test criteria, the chief source of 
misclassification of circuits are the inherent errors associated with regression and the 
non-idealities of the tester. As is discussed below, these non-idealities effect our test 
decision and how to identify circuits which needs to be tested further with the 
specification tests for fault detection. 

As identified in the foregoing, errors associated with the measurement synthesis 




[Equation 12] 



where Shn takes values ±1 and 




[Equation 13] 
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can increase the likelihood of misclassifying circuits. Accordingly, it is advisable to take 
these errors into consideration when synthesizing the mapping functions. Due to the 
regression approximation the ideal synthesizing function fmsi is related to the synthesizing 
function / ^ obtained using MARS by equation [14], where e ri is the residual of 
regression. 

Sj = f msi ( m ) = / msi(m) + e ri [Equation 14] 

The residuals do not contain any information about the function that we are trying to 
approximate and they are usually modeled as normally distributed random variables with 
zero mean (e - Af(0,cr e 2 n .))- Tte variance can be easily calculated from the 
training data without performing any additional circuit simulation. 

To incorporate the effect of random measurement errors, the independent 

variables m in f msi{m) can be replaced with The errors in measurement (e m *) 

can be modeled as normally distributed random variables with zero mean and known 
covariance matrix Z em (17). 

e m *~N(Q£ em ) [Equation 15] 



20 



For estimating the errors in the synthesized measurements, the way in which the 
statistical distribution of the measurement errors are altered by the synthesizing function 
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(f msi) can be investigated. The random error in the synthesized measurement can be 
modeled as normally distributed with zero mean and variance a 2 which can be 
evaluated by simulation. It is to be noted that the variance can be estimated by evaluating 
the synthesizing function using a set of measurements with errors injected according to 
5 the measurement error statistics. This can be done without performing any additional 
circuit simulation. Thus, the following can be obtained 

?«i5i(m + e m *) = ?m.«(m) + e mi [Equation 16] 

10 where e m rN(0, cr 2 emi ). Substituting this expression with measurement errors 
incorporated, in equation [14] yields 



15 Assuming that the errors e mi and e ri are independent and normally distributed, equation 
[17] reduces to 

Sj-f msi(m) + e i [Equation 18] 



20 where e m ,~N(0, &].) and 
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a 2 = cr 2 . + cr 2 . [Equation 19] 

ei emi en *■ 



In equation [18], m is the actual measurements that we are making on the CUT for fault 
detection, f msi(m) = 0, is the synthesized measurement. The random error, e it is the 
deviation of the synthesized measurement from the actual performance parameter sj. 
Using the variance a 2 , we can define a band 8\ around the specification bound 6, as 
given as 

8, = 3 'G e t [Equation 20] 

If the synthesized measurement 9, of the CUT is within this band we cannot make 
a confident decision as to whether the CUT is good or bad by looking at the synthesized 
measurement. To decide if the CUT is good or bad we need to subject it to the i th 
specification test. Thus specification bound bi and the band 5i constitutes the test criteria 
for the synthesized measurement Gj. Figure 6 shows an example test flow diagram for 
production testing of analog ICs using measurement synthesis. With reference to block 
60, given the acceptable ranges of all specifications, the measurement uncertainty due to 
inaccuracies in measurement instrumentation and modeling errors, and the mathematical 
prediction functions for predicting the circuit specifications form test response 
measurements, flow continues to block 61 in which it is determined whether the circuit 
needs further testing. If further testing is needed, specification tests can be conducted in 
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block 64. If not all of the specifications have been computed, flow continues from 62 to 
block 65 in which, for a selected specification, the specification value is predicted from 
the response measurement. Next, at 66, it is determined whether the predicted value is 
such that it is certain that the circuits is good despite uncertainties. If not, flow continues 
back to block 61. If so, however, flow continues to 67 in which it is determined whether 
the predicted specification value is such that it is certain that the circuit is bad despite the 
uncertainty of 8,-. If not, flow continues to block 68, and the specification value is very 
close to the boundary of acceptance for the specification. Flow then returns to block 61 
where the process is repeated. From this flow diagram, it is clear that if any of the 
synthesized measurements declare the circuit as faulty, then at least one of the 
specification is violated and further testing is unnecessary. If all the synthesized 
measurements declare the circuit to be fault free then the CUT is good. If the circuit has 
a few critical specifications and is not faulty, then we need to subject the CUT to the 
critical specification tests to determine if the circuit is bad or good. 

An objective during the test design and while deriving the synthesizing functions 
is to minimize the number of circuits which need further specification testing. This in 
turn can be achieved by minimizing the variance a 2 ei • To minimize this variance, the 
individual variances of the two errors e mi and e ri can be minimized. The variance of the 
error due to regression can be minimized by appropriately selecting the training circuit 
instances for the MARS. 

For the synthesizing functions, measurements are the independent variables and 
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the performance parameters are the dependent variables. A set of appropriate circuit 
instances in the process parameter space can therefore be selected and mapped to the 
performance parameter space and measurement space by circuit simulation. The 
accuracy of the generated MARS model depends heavily upon the circuit instances used 
5 for building the model. From equations [9] and [10] it can be understood that the 
synthesized measurements must track the corresponding performance parameters very 
well near the specification bound. Hence, to obtain a very accurate synthesizing function 
(low cx 2 eri ) near the specification bound, the training set typically must contain a large 

number of circuit instances which lie close to these bounds (critical circuit instances). 

J0 However, the boundary of the acceptance region in the process parameter space is not 
known a priori. One straight forward way of generating a critical circuit instances is to 
randomly select circuit instances in the process parameter space and simulate these 
circuits and see if the performance parameter is close to the specification bound. This 
will involve a large number of circuit simulations. Hence, the example procedure shown 

j g in Figure 7 can be used to dynamically generate the critical circuit instances required for 
training. As shown in this figure, the process statistics and specifications can be input, as 
indicated in block 70. If all of the specifications have been considered (71), flow 
continues to block 72 where descriptions of circuits having specification values very 
close to the specification boundaries are generated. If, on the other hand, not all of the 

20 specifications have been considered, flow continues to block 73 in which sets of current 
descriptions with different process parameter values are randomly generated using the 
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10 



supplied process statistics. At block 74, a mathematical function of f is built which 

maps the random process parameter values to their respective specification values. This 
function can then be used to determine what the process parameters should be so that the 
circuit specifications will be close to or at the respective specification boundaries. Each 
set of process parameters thereby determine, by simulation, the corresponding 

specification values. If these values differ from the predicted values (f psi ) by less than a 

specified error (ErroMax) at 75, then flow continues to block 77 and the process is 
repeated. If not, however, flow continues to block 76 where, for newly generated circuits 
whose specifications do not lie close to the specification boundary, flow will continue 
back to block 74. 

For each of the specifications one can start with a set of circuit instances 
generated by randomly sampling the process parameter space. Then a coarse MARS 
model is built relating the process parameters to the performance parameter of the CUT. 
This procedure takes this MARS model and finds a set critical circuits instances. This 

25 procedure uses binary search algorithm with the nominal circuit instance and a randomly 
selected circuit instance as the initial guesses to search for a critical circuit instance. 
Using these newly generated circuit instances, the average squared error between the 
performance parameters predicted and those obtained through simulation can be 
calculated. If this error is less than a predefined value, the existing MARS model is 

2Q accurate near the specification bound, else more circuits are added to the training set to 
improve the model accuracy. The outputs of this routine are the MARS model relating 

22 



TKHR Docket No. 62004-1400 



the circuit performance parameters to the process parameters and a set of critical circuit 
instances. 

For efficient production testing of analog circuits, it is desirable to minimize the 
number of measurements. By minimizing the number of measurements, the variance, 
<r 2 , is minimized. Moreover, the average production testing time is also minimized. 

emi 

Nevertheless, eliminating measurements might led to loss of information about the 
performance parameters of the circuit. This an increase in the variance a * H . Hence, only 
those measurements should be eliminated if used for deriving the synthesized 
measurements increases the overall variance a 2 ei • 

One straight forward method to extract the information content in all the 
measurements is principal component analysis (PCA). However, principal components 
of the measurement data are a linear combination of all the measurements itself. Hence 
PCA cannot be used directly for measurement selection. Therefore, a heuristic based on 
measurement ordering to select a set of measurements is used which will give a 
minimum variance a 1 • 

ei 

The procedure OrderMeasurements, shown in FIG. 8, removes one measurement 
at a time from the list of measurements and calculates the variance a 2 ei of the 
synthesizing function derived using the remaining measurements. The measurements are 
then ordered in the ascending order of the variance a] r The procedure 
SelectMeasurements (FIG. 8) then takes this ordered list of measurements and adds one 
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measurement at a time to the list of selected measurements and derives the synthesizing 
function using these selected measurements. Initially, the overall variance cr 2 reduces 

because we increase the accuracy of our regression by adding more measurements. After 
adding a few measurements, the addition of more measurements do not result in an 
^ increase in the accuracy of the regression model. However, the variance cr 2 mi increases 
because we are introducing more measurement error with the addition of a new 
measurement. This leads to an increase in the overall variance <j 2 . Once <j 2 start 

ei ei 

increasing, we stop adding new measurements and the final list of measurements will 
give a minimum variance of the errors. 

10 

Test Stimulus Generation 

The synthesis between measurements and performance having been desired in the 
foregoing, derivation of an optimized input stimulus will now be described. For DC and 
AC tests, the search space is small and a set of tests (input to SelectMeasurements()) can 

J5 be selected by uniformly sampling the range of possible DC input voltage and frequency 
of the sinusoidal test signal. However, for transient input stimulus the search space is 
very large. In searching for the best piece-wise linear (PWL) stimulus by dividing the 
time axis into nj divisions and voltage axis into ri2 divisions, there are possible 
solutions. For such problems, genetic algorithms have shown the ability to move towards 

20 better solutions by selecting possible solutions from a large search space. Hence, genetic 
algorithms can be used to search for the optimum PWL transient stimulus and sampling 
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points. 

As explained above, the chief reasons for misclassification during testing are the 
measurement errors and regression errors. The problem of misclassification becomes 
severe near the boundaries of the acceptance region. This can be explained with the help 
5 of Figure 9. In the figure, a p is the standard deviation of the measurements around the 
nominal fault free circuit instance due to the process vaiations and a e is that due to the 
measurement errors. Circuit instance pi is well within the region of acceptance, p 3 is 
outside the acceptance region and p2 is at the measurement threshold. In the figure we 
show the distribution of the measurements performed on these circuit instances. From 

JO the figure it is clear that pi and p 3 are always classified correctly even in the presence of 
measurement errors. However, there is a high probability that, p2, the circuit instance at 
the boundary of the acceptance region is misclassified. The chances of misclassification 
reduces if the ratio is ap/a e increased. Thus a good test need to have the standard 
deviation due to the process variations much greater than that due to the measurements. 

j ^ An objective during test design is to increase the standard deviation a p by appropriately 
choosing the measurements. This, in turn, can be achieved by selecting those 
measurements which are sensitive to the process parameter deviations of the circuit. 

Earlier sensitivity based test generation methods were formulized to maximize the 
sensitivity of the measurements to the process parameter variations of the nominal circuit 

20 instance. Maximizing the sensitivity of the measurements to the process parameter 
deviations around the nominal fault free circuit often does not help, especially for circuits 
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with loose specifications. If the specifications are not tight, increasing the sensitivity of 
the measurements to the process parameters for the nominal circuit will not necessarily 
increase the sensitivity of the measurements to the process parameters for the circuit 
instances near the boundary. This will lead to large rates of misclassification for a drifted 
manufacturing process. Thus our objective during test generation is to derive 
measurements which are highly sensitive to the process deviations of the critical circuit 
instances. Thus the fitness function for a set of n m measurements is given by equation 
[23], where n c is the number of critical circuit instances. We select one worst-case circuit 
instance per single-ended specification to evaluate the fitness. This worst-case critical 
circuit instance is the one which is nearest to the nominal circuit instance (lowest 1 2 
norm) among all those generated by GenerateTrainSetQ 



based on their fitness. After crossover and mutation of the existing population, the 
evolved new population again undergoes selection, crossover and mutation to give a 
population with individuals having better fitness functions. To conduct the genetic 
search, the search space typically must be encoded into genetic strings or chromosomes a 
set of rules must be provided for selection, crossover, mutation and fitness evaluation for 
these genetic strings. For example, the following rules could be established: 

String encoding : The i* gene of the genetic string is an integer representing the 




j=\ i=\ k=\ 



[Equation 21] 
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voltage at time point f,- (equation [22]). Thus, if the f h gene has a value j 9 the 
corresponding voltage of the PWL transient waveform is given by equation [23]. The 
string length of the population is equal to the total number of time divisions n t . FIG. 10 
shows the encoding in detail. In the figure, maximum voltage was assumed to be 5V and 
^ there are 5 voltage divisions and 5 time divisions. 

t . = fm^L / [Equation 22] 

Vin 

Vin{t t ) = j [Equation 23] 

Selection : The selection of strings for crossover is biased towards strings having 
the highest fitness value so that the average fitness of successive populations tends to 
2Q increase. Tournament selection can be used for selecting the parents for reproduction. 
Tournament selection involves picking two strings from the population and selecting the 
better for reproduction. 

Crossover : The crossover operator takes genes from each of the parent string and 
combines them to create child strings. A uniform crossover scheme can then be used for 
j 5 creating child strings. FIG. 1 1 shows how uniform crossover is performed to produce the 
child strings. Each gene of the parent strings is chosen with certain probability and are 
swapped to yield the two child strings. 

Mutation : After the child strings are created, the genes of the child strings can 
undergo mutation. For mutation, a gene is selected with a certain probability (mutation 
20 probability) and is replaced with a random number within the allowed range. 
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Fitness evaluation : One measurement in a particular segment of the PWL 
transient waveform is suade. Hence, he total number of measurements is equal to the 
string length N. The fitness is equal to the sum of absolute value of the sensitivities of 
the measurements to the process parameters for the critical circuit instances. 

5 

EXAMPLE 1 

Table 1 provides the performance specifications of an operational amplifier. In 
the absence of real data from the silicon foundry, it is assumed that the specification 
failure in this operational amplifier is caused by variations in seven parameters namely, 
L0 the threshold voltages (V ton V t0 p), gate oxide thickness (T ox ), aspect ratios ((W/L)„, 
(W/L) p ), bias resistance ( Rb ias ) and compensating capacitor (CC). For the purpose of this 
example, it is assumed that the test measurement hardware has the capability of 
measuring small signal voltage gain of the operational amplifier for fault detection with 
0.1 % accuracy. 



Table 1: Specifications of the Compensated Operational Amplifier 



15 



Performance 




Number of 


Parameter 


Specification 


Measurements 


Bias current 


<2mA 


11 


F.3dB frequency 


> 37 KHz 


2 


DC gain 


>49dB 


1 


Phase margin 


>82° 


1 


Gain margin 


>23dB 


3 



First, the training set for building the synthesizing function for each of the 
specification was generated using the algorithm FindTrainSetO- The voltage gain at a set 
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of 25 equally spaced frequency points on a logarithmic scale between DC and 150MHz 
were chosen for fault detection. Next, the 25 measurements were ordered using 
OrderMeasurements() and a subset of these measurements were chosen for deriving the 
synthesizing functions using SelectMeasurements(). The number of measurements 
needed to derive each of the synthesized measurements are given in Table 1. Thus, the 
synthesized measurement for bias current was derived from 1 1 measurements and that for 
the fs dB frequency was derived from 2 measurements, and so on. Totally, 15 
measurements are needed to derive all the synthesizing functions indicating that some 
measurements are used to derive more than one synthesizing functions. 

The value of 5i was determined for each of the synthesized measurements. The 
bound 38i and the specification bound constitutes the test criterion for the optimized tests. 
To evaluate the generated tests, 1000 Monte Carlo samples were generated (assuming 
independent normal distributions with 10% tolerance for parameters) of the operational 
amplifier and marked as faulty or fault free using the conventional specification tests. 
The fifteen selected measurements were made on these circuit instances and random 
measurement errors were injected to incorporate measurement non-idealities. Using 
these measurements with measurement errors incorporated, five synthesized 
measurements were derived (one corresponding to each of the circuit specification) using 
the precomputed synthesizing functions. Using the derived test criteria and the test flow 
given in Figure 6, the circuits were classified into three categories. Table 2 summarizes 
the simulation results. 
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Table 2: Simulation Results on the Compensated Operational Amplifier 



Performance 
P a ra m eters 

A CU CUllv Ivl i3 


Good Circuits 


Bad Circuits 


Total 


Declared as 
good 


Needs 
Further 
Testing 


Miscla 
ssified 


Total 


Declared 
as Bad 


Needs 
further 
Testing 


Miscla 
ssified 


Bias Current 


776 


744 


17 


15 


224 


183 


20 


21 


F. 3 dB 
frequency 


783 


780 


3 


0 


217 


213 


2 


2 


DC gain 


849 


849 


0 


0 


151 


151 


0 


0 


Phase margin 


999 


998 


1 


0 


1 


0 


0 


1 


Gain margin 


894 


11 


35 


11 


60 


42 


13 


5 


All 


447 


419 


20 


8 


553 


509 


24 


20 



Out of 1000 circuits, 776 were found to satisfy the specification on bias current. 



Using the synthesized measurements 744 of these circuits were classified with a high 
degree of certainty. Out of the remaining 32 circuits, 17 had an uncertain test outcome. 
Hence for these 17 circuits, bias current is a critical performance parameter. Similarly, 
20 circuit instances (out of 224) those did not satisfy the specification on the bias current 
have bias current as a critical performance parameter. 

When all the specifications are considered, the synthesized measurements are able 
to correctly classify 93% of the CUTs. Out of the remaining 7%, 4.5% had an uncertain 
test outcome stet. These circuits are then subjected to the critical specification tests for 
fault detection. Thus only remaining 2.5% of the CUTs are misclassified by the proposed 
test procedure. 

It is to be noted that not all the 44 circuits with uncertain test outcome were 
subjected to all the specification tests. From the table it can be seen that bias currents of 
37, £ 3 dB of five, phase margin of one and gain margin of 48 circuits are to be measured. 
Thus, in worst case, only 91 performanc parameters must be measured to correctly 
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classify 97.5% of the CUTS. 

EXAMPLE 2 

Now the simulation results on an ITC97 bench mark circuit, state-variable filter will be 
5 discussed. The faults in the state-variable filter were assumed to be due to variations in 
16 parameters, seven of them are the process parameters of the operational amplifier and 
the remaining nine are the values of passive components of the state variable filter. For 
the state-variable filter, two double-ended specifications and one single ended 
specification were considered. The performance parameters and the specifications are 
given in Table 3. 



Table 3: Specification of the State- Variable Filter 



Performance Parameter 


Specifications 


Number of Measurements 


Center Frequency of the Band- 


>750Hz 


1 


Pass Filter (f c ) 


<850Hz 


4 


Maximum gain (K) 


>1.0 


3 




<1.2 


1 


Q-factor (0 


>1.0 


11 



To test this circuit, transient tests were generated using the methods described 
herein. To generate a training set for test generation, the two double-ended specifications 
were decomposed to single-ended specifications to give a total of five single-ended 
specifications. Circuit instances were generated for each of the five single-ended 
specifications using GenerateTrainSet(), and five circuits (one corresponding to each of 
the single-ended specification) with minimum distance (/ 2 , norm) from the nominal 
circuit were selected for generating the optimum PWL input stimulus. To generate the 
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optimum PWL input stimulus, a maximum testing time of 5ms was assumed. For 
encoding the PWL input into the genetic string, a string of 20 genes (giving 20 PWL 
segments) was assumed and the voltage at the corner points of the PWL segments was 
quantized to 20 levels between -5V and 5V. 

The output of the CUT was sampled at 20 equally spaced time points for fault 
detection. For each of the five single-ended specifications, these 20 measurements were 
ordered and a subset of measurements were chosen to derive the synthesizing functions. 
For measurement ordering and selection, a measurement error of 1% was assumed. The 
number of measurements required for each of the synthesizing functions is given in Table 
3 along with the corresponding specifications. 

The generated tests were evaluated as described for the operational amplifier 
using 1000 Monte Carlo samples of the state-variable filter assuming independent normal 
distribution for the process parameters with 10% tolerance. Table 4 summarizes the 
simulation results. When all the circuit specifications were considered, out of 824 good 
circuits, 83% were declared as good by the derived tests, 10% needed further testing, and 
7% were misclassified. Out of 176 bad circuits, 72% were classified as bad by the test, 
20% needed further testing, and 8% were misclassified. Thus, with 16 time domain 
measurements and a few (maximum 182) performance parameter measurements, 93% of 
the circuits were correctly classified in the presence of 1% measurement error (in 
transient measurements). This, as compared to a total of 3000 performance parameter 
measurements, reduces down the overall testing time of the state-variable filter. Notice 
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that, for this example, a higher percentage error was assumed for the measurements as 
compared to the operational amplifier example. That is why a 7% misclassification is 
obtained as compared to 2.6% in the previous example. 



Table 4: 



Specifications 


Good Circuits 


Bad Circuits 


Total 


Declared as 
good 


Needs 
Further 
Testing 


Miscla 
ssified 


Total 


Declared 
as Bad 


Needs 
further 
Testing 


Miscla 
ssified 


F<>75(mz 


930 


868 


36 


26 


70 


50 


13 


7 


F c <850Hz 


945 


919 


14 


12 


55 


45 


8 


2 


K>1.0 


993 


992 


0 


1 


7 


1 


5 


1 


K<\2 


964 


891 


49 


24 


36 


24 


6 


6 


0>1.O 


964 


891 


49 


24 


36 


24 


2 


7 


All 


824 


687 


80 


57 


176 


126 


35 


15 



While particular embodiments of the invention have been disclosed in detail in the 
foregoing description and drawings for purposes of example, it will be understood by those 
skilled in the art that variations and modifications thereof can be made without departing 
from the spirit and scope of the invention as set forth in the following claims. 
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